Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 




Bescheinigung Certificate 



Attestation 



Die angehefteten Unter la- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nSch- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung Qberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

02020134.9 



PRIORITY 
DOCUMENT 

COMPLIANCE WITH RULE 17.1(a) OR(b) 



Der Prasident des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 



R C van Dijk 



Europaisches 
Patentamt 



Europ 
Patent 



• 



Office europeen 
des brevets 



Anmeldung Nr: 
Application no. : 
Demande no: 



02020134.9 



Anmeldetag: 
Date of filing: 
Date de depot: 



09.09.02 



Anmel der/Appl 1 cant( s)/Demandeur( s) : 

Sony Ericsson Mobile Communications AB 



221 88 Lund 
SUEDE 



Bezelchnung der Erf 1 ndung/Tl tie of the 1 nvent1on/T1 tre de IMnventlon: 
(Falls die Bezelchnung der Erflndung nlcht angegeben 1st, slehe Beschrel bung. 
If no title Is shown please refer to the description. 
S1 aucun tltre n'est 1nd1qu6 se referer a la description.) 



User inputs on a touch screen 



In Anspruch genommene Prlorlat(en) / Pr1or1ty(1es) claimed /Priori t6(s) 
revend1qu6e(s) 

Staat/Tag/Aktenze1chen/State/Date/Rle no. /Pays/Da te/Nume>o de depot: 



Internationale Patentklasslf 1 kat1 on/International Patent Classification/ 
Classification Internationale des brevets: 

G02F/ 



Am Anmeldetag benannte Vertragstaaten/Contr acting states designated at date of 
flllng/Etats contractants d€s1gn€es lors du de*pot: 

AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR 



02020134. 9 

EPVEP0/0EB Form 1014.2 - 01.2000 7001014 



2 



ROG NR. 320 09*09. '02 10=39 ID:STRtiri&GULLIKSSQN STHLM ; FAX: +46 8 54549349 SIDA 10/2 



M^4S 



1 

USER INPUTS ON A TOUCH SCREEN 



TECHNICAL FIELD OF THE INVENTION 

5 The present invention relates to the field of portable electronic devices having touch 

screens on which information can be input. More particularly the present Invention relates 
to a movement input device and a portable electronic device having a touch screen and 
including such a movement input device, where movement inputs are detected on the 
touch screen. 

10 

DESCRIPTION OF RELATED ART 

It Is known within the field of portable electronic devices to provide these with touch 
screens. For instance Ericsson has a mobile phone model R380, which has a touch screen 

IS and a flip provided with keys that go through the flip and touch the touch screen for 
entering numbers and selecting functions. The mobile phones of today are getting more 
and more advanced and also often have different applications like games provided in them. 
In the future it might also be possible to download applications into them. When a user of 
a phone is playing such games, he will often feel a need for a user input device that can 

20 provide movement information, for example for positioning, In an way that Is free at least 
regarding angle around an axis of the device. 

There exist several such devices today, for Instance Joysticks or game pads for providing 
such movement Input to computers and game machines, 

25 

, Today there does however not exist such a movement Input device for portable electronic 
devices having touch screens, which are cheap and can be used easily. Such a device can 
be provided directly on a touch screen, but then it is limited to arrow buttons. Arrow 
buttons on a touch screen do not give the user a good enough control of a game to be 
30 played. Today the space on portable electronic devices Is furthermore limited, why extra 
devices and Input devices on them have to be considered carefully before being added to 
the ones already existing. 



There exist a joystick that can be fitted on a phone for playing games. This device exists 
35 for a number of Nokia mobile phone models and uses the buttons provided on the phone 
for providing four-way movement with four of the original phone buttons. This is however 
a "digital" type of movement and will not give a user the best way of performing 
movement in a game. This is no real improvement to providing arrow buttons directly on 
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the touch screen, but rather replaces It. A user Is thus here limited to movement In four 
directions decided by the underlying keys. 

US 5,982,355 describes a joystick that Is provided on a touch screen of a remote control. 
5 However here the movement of the joystick is sensed by different type of sensors like Hall 
effect sensors or strain gauge sensors. This is thus equivalent to providing a separate user 
motion input device. 

There Is thus still a need for a simple end cheap movement input device to be used in 
10 conjunction with a touch screen and which can receive user Inputs that at least correspond 
to the user movement of the device In an angle around an axis provided generally 
perpendicular to the touch screen. 



IS 



SUMMARY OF THE INVENTION 

The present invention is thus directed towards the problem of providing fine detection of 
user movements with a movement Input device in relation to a touch screen. 

Another problem that the invention Is directed towards is the problem of providing full 
20 detection of at least the angle of rotation around an axis by a movement input device 
provided for a touch screen - 

One object of the present Invention is thus to provide a movement Input device, which 
provides fine detection of user movements with a movement Input device in relation to a 
25 touch screen. 

According to a first aspect of the invention this object Is achieved and this problem Is 
solved by a movement input device for use on a touch screen of a portable electronic 
device comprising: a fastening unit for securing the movement Input device on the 

30 portable electronic device and having a top and bottom side, said unit also being arranged 
for being placed over at least parts of the touch screen, and a user input unit fastened in 
and stretching through the fastening unit. The user Input unit comprises: a user actuation 
part protruding from the top side of the fastening unit and being possible to actuate by a 
user for free angular movement with an angle of rotation around an axis provided at least 

35 generally perpendicular to the top and bottom sides of the fastening unit, and a touch 

screen contact part protruding from the bottom side of the fastening unit, which, when the 
device is placed for use on the touch screen and upon actuation by the user of the user 
actuation part, is arranged to contact the touch screen in a position where at least an 
angle of the contact position corresponds to the angle of the user actuation part, so that 
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3 

movement of the user input unit Is detected on the touch screen. A second aspect of the 
Invention includes the features of the first aspect, wherein the user actuation part and the 
touch screen contact part furthermore are Joined together by a fastening part being 
fastened In the fastening unit while still allowing free movement round said axis. 

5 

Another problem that the present Invention solves is the provision of "analog" detection of 
radial movement of the movement input device. 

<« 

A third aspect of the present Invention solves this problem. The third aspect of the 
10 invention includes the features of the first aspect, wherein the touch screen contact part 
furthermore comprises a pin for direct contact on the screen so that a radial movement of 
the touch screen contact part from the axis corresponds to the radial movement of the 
user actuation part. 

15 A fourth aspect of the Invention includes the features of the third aspect, wherein the 

touch screen contact part also comprises a spring arranged to force the pin in contact with 
the touch screen. 

A. fifth aspect Of the invention Includes the features of the first aspect, wherein the touch 
20 screen contact part further comprises a disc having a rim, which contacts the screen at a 
fixed distance from the axis of the screen upon actuation of the user actuation part. 

A sixth aspect of the present invention includes the features of the fifth aspect, wherein 
the disc has parabolic shape. 

25 

Another object of the present invention is to provide a portable electronic device, which 
provides fine detection of user movements using a movement input device together with a 
touch screen. 

30 According to a seventh aspect this object Is achieved by a portable electronic device 
comprising: a body comprising: a touch screen for detecting inputs from a user on said 
screen, and a movement input device for use on said touch screen comprising: a fastening 
unit for securing the movement Input device on the body and having a top and bottom 
side, said unit also being arranged for being placed over at least parts of the touch screen, 

35 and a user input unit fastened In and stretching through the fastening unit. The user Input 
unit comprises; a user actuation part protruding from the top side of the fastening unit and 
being possible to actuate by a user for free angular movement with an angle of rotation 
around an axis provided at least generally perpendicular to the top and bottom sides of the 
fastening unit, and a touch screen contact part protruding from the bottom side of the 
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fastening unit, which, when the movement Input device is placed for use on the touch 
screen and upon actuation by the user of the user actuation part, is arranged contact the 
touch screen In a position where at least an angle of the contact position corresponds to 
the angle of the user actuation part, so that movement of the user input unit is detected 
5 on the touch screen. 

An eight aspect of the Invention includes the features of the seventh aspect and further 
includes an input determination unit (40) for determining positions of Input from a user. 

10 A ninth aspect of the Invention includes the features of the seventh aspect, wherein the 
fastening unit is further rotatably connected to the body. 

A tenth aspect of the invention includes the features of the ninth aspect, wherein the body 
further comprises a fastening unit sensing device arranged to sense if the fastening unit is 
15 in position for providing inputs from the movement input device on the touch screen. 

An eleventh aspect of the invention includes the features of the seventh aspect, wherein 
the device is a mobile phone. 

20 The invention has the following advantages. It does not take up any extra space on the 
phone. It also uses the touch screen display, which is already provided on the phone. 
Since the movement input device only includes mechanical components, it is cheap and 
easy to manufacture. It also allows good position sensing, which is an advantage in some 
applications, like for Instance games. 

.25 

According to a preferred embodiment of the invention both angular.and radial movement 
of a movement input device are detectable in an "analog" fashion. 

According to a second embodiment of the invention only the angular movement of a 
30 movement input device is detectable in ^analog" fashion. The radial movement is here 
detected in "digital" fashion. 

It should be emphasized that the term "comprises/comprising" when used in this 
specification Is taken to specify the presence of stated features, integers, steps or 
35 components, but does not preclude the presence or addition of one or more other features, 
Integers, steps, components or groups thereof. 



I A • 1 1 



KUG NR. 320 09.09. '02 10:40 IDrSTRfln&GULLIKSSON STHLM FAX: +46 8 54549349 Sib ft Us 2 



5 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described In more detail in relation to the enclosed 
drawings, In which: 

5 

fig. l shows a portable electronic device in the form of a mobile phone having a touch 
screen, 

fig. 2 shows the portable electronic device on which a movement Input device according to 
the Invention is provided, 

10 fig. 3 shows the movement input device according to the Invention by Itself, 

fig. 4 shows a sectional view of a movement input device according to a first embodiment 
of the invention as well as relevant parts of the portable electronic device, 
fig. 5 shows a sectional view of a movement input device according to a second 
embodiment of the Invention as well as relevant parts of the portable electronic device, 

15 fig. 6 shows a block schematic of the Interior parts of the phone used when using an 
application, 

fig. 7 shows a first variation of a user actuation part according to the invention, and 
fig. 8 shows a second variation of a user actuation part according to the Invention. 

20 DETAII^D DESCRIPTION OF EMBODIMENTS 

A portable electronic device 10 according to the invention is shown In fig. l. in the 
preferred embodiment the device is a mobile phone 10 having an antenna 12 and a display 
14. It should be realised that the portable electronic device need not be a phone, but can 
25 be any other type of portable electronic device, like a PDA (personal digital assistant), a 
palm top computer, a lap top computer or some type of gaming machine for playing 
games. The screen 14 Is here a touch screen onto which it is possible to enter Information 
directly onto the screen such as selection of functions or applications and controlling these 
functions and applications. 

30 

In the phones of today there are emerging more and more applications for instance in the 
form of games that can be played. These games can be provided In the phone 
beforehand, be downloaded into the phone from a network or added to the phone In some 
other suitable way. These applications can often need a joystick or some other type of 
35 Input device that provides movement Input. It is hard to provide such devices directly on 
the screen and a user furthermore often prefers to hold the Joystick In his hand when for 
-Instance playing games. In order to solve this, the phone shown in fig. i Is provided with a 
movement input device according to the invention. The combined phone and movement 
input device are shown in fig. 2. The movement Input device Includes a fastening unit In 
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the form of a lid 16 provided with a user input unit in the form of a Joystick 18. the 
movement Input device may also include gaming buttons 19. The joystick 18 and buttons 
are used In conjunction with the touch screen 14 of the underlying phone 10. The Hd 
covers at least parts of the touch screen. 

5 

The fastening unit can be provided in many ways. It can be a flip, which Is securely 
fastened onto the body of the phone and rotatable around the bottom end of the phone. It 
can be a sliding body, which slides up and down along the length of the phone. It can also 
be a lid, which Is snapped on, either with hinges for rotation around the body or without, it 

10 can also be provided in the form a sleeve to the phone. It can furthermore be provided In 
the form of a thin plate, which engages the sides of the phone In order to stay placed over 
the touch screen and only has enough space for retaining a user Input unit. There are thus 
a number of ways In which the device can be fastened to and be made to cooperate with 
the phone. In order to demonstrate that the movement Input device can be separate from 

15 the phone It is shown by Itself in fig. 3. The movement input device can furthermore 
Include mora or fewer buttons than what Is shown. It can for example also include keys 
that are to be used for telephony and also be provided without the gaming buttons 19. In 
Its simplest form It is thus provided with only a joystick or some other type of user input 
unit. 

20 

The movement input device can be a part sold together with the phone or a part provided 
as an extra accessory and sold separately, for instance from a game provider. 

Fig. 4 shows a sectional view of a first preferred embodiment of the movement Input 
25 device according to the Invention together with different parts of the cellular phone 10, 
where the section has been taken along line IV - IV of fig. 2. The gaming buttons have 
here been omitted for better understanding of the invention. These do however contact the 
touch screen In a known way, when being depressed. The user input unit 18 is in constant 
• contact.with the touch screen 14 via the lid 16. The touch screen 14 is provided in a body 
30 24 of the phone, which also comprises a PCB (printed circuit board) 20 including a number 
. of circuits as well as a battery 22. The user input unit 18 includes a user actuation part 26 
in the form of a stick functioning as a Joystick, joined to a touch screen contact part 28 via 
a ball shaped fastening part 30. The lid has a top side from which the user actuation part 
26 protrudes and a bottom side from which the touch screen contact part 28 protrudes. 
35 The fastening part 30 is placed in a compartment inside the lid 16 formed after the shape 
of the fastening part. It should be realised that this is just one way of providing fastening 
of the user input unit In the lid. There are many other ways in which this can be done. 
What is Important though Is that the user input unit is securely fastened In the lid while 
allowing free movement in relation to an axis at least generally perpendicular, to the lid and 
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to the touch screen 16 when the (id I* p.aced thereover. The axis is denoted with X and Is 
shown going straight through the middie of the user Input unit, when a user does not 
actuate this unit. The axis is thus a.so generally perpend.cu.ar to the top and bottom s.des 
or the lid. 

5 

The touch screen contact part 28 Is shown In an eniargement Cose to the device. From this 
enlargement it can be seen that the touch screen contact part 28 Includes a pln 34 
fastened to the rest of the user input unit via a spring 32. The spring .s dimensioned so 
that enough pressure is provided for receiving movement information while at the same 
10 time avoiding damage to the touch screen. The dev.ce can function without the spring, but 
then unwanted damages on the touch screen might occur. The pin 34 also has a biunted 

nTu t n u nTL n0t t0 UnneCBS5ar,,V SCratch the '''he touch screen 14. With this user 

input unit, the user actuation part 26 can be moved freely all the way round the axis X 
D.fferent sizes of radial movement are also possible to obtain. Because of the pin 34 the 

15 touch screen then can detect the whole angular movement round the axis X made by a 
user and also the complete radial movement that is possible to be made by a user The 
screen thus detects a corresponding angle and radial movement. There Is a slight 
difference between actuated and detected angle In that the detected angle is opposite to 
the angle moved by the user. This Is easily handled by the application in question or by a 

20 separate movement translator provided in the phone. All angular movements and a.so all 
allowed radJal movements are thus detected. The device is thus "analog- in nature. 

It is possible to provide a direct angular correspondence between the user actuation part 
and touch screen contact part In a variation of the above-described embodiment. This is 
25 done by using a pair of meshing gears provided between the user actuation part and the 
touch screen contact part. This is however a somewhat Ineffective and expensive method. 

Fig. S shows a sectional view of a second embodiment of the movement input device 
according to the .nventlon. Here the parts of the phone are the same as shown in fig 4 

30 and the user actuation part is also the same as before, why these will not be described 
further. The difference here is that the touch screen contact part has another shape. The 
touch screen contact part 36 Is here provided in the form of a parabolically shaped disc 
facing the touch screen. In the unused state this disc is not in contact with the touch 
screen 14. When the user actuation part 26 .s moved, a point of the rim of the disc will get 

35 in contact with the touch screen 14, which point is then detected to be used by the 

application. With this touch screen contact part 36 free movement around the axis is also 
allowed. All angular movements are thus detected. The angular movement is thus analog 
in nature. The radial movement is however always of the same magnitude. The radial 
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movement Is thus "digital" in nature. This device does not need a spring and here there 
does not have to be a translation of the angle either. 

The disc can be varied In many ways. It does not have to be parabolic, although this Is 
5 preferred. It can also be provided by a disc having a number of sides for Instance 32 or 64 

sides, each curved though- The position will then not be as exactly indicated as with a 
. parabolic disc. It is also possible to have a plane round disc instead 

Fig. 6 shows a block schematic of some of the parts of the phone In fig- 1. The touch 

10 screen 14 is connected to an Input determination unit 40, which in turn is connected to an 
application unit 38 on which an application is run and preferably a game. The input 
determination unit 40 determines type of input by a user on the touch screen. This input 
determination unit determines If the input Is a movement Input or another type of input. If 
it is a movement input it calculates rotated angle, possible radial movement and possible 

15 angle translations. Here the area of the touch screen where the user Input unit can be in 
contact has been defined as an application user area. When using the movement Input 

■ device together with an application like a game, parts of the display, normally the part not 
covered by the lid, is used for displaying the game and the other part covered by the lid is 
provided as an input portion. The gaming buttons 19 can here also be used for additional 

20 functions than movement, and would then also act on the touch screen in a known way. 

Fig. 7 shows a variation of the user actuation part. In the previously described 
embodiments It was a stick. It can however also be a cross shaped thumb plate 42 as In 
fig. 7 or a thumb plate 44 of circular shape as In fig. 8. The plate can also have four 
25 corners or eight corners. There are thus a number of possible shapes. 

. When using the movement input device according to the Invention there might be other 
variations provided in the phone. The phone might accept several different lids, where one 
is used for games and another for phoning etc. In this case the phone might be provided 

30 with a sensor In the body sensing that there is a lid present and in case of a lid 

automatically associating the part of the touch screen to be used for movement Input. This 
can be complemented by another sensor sensing what type of lid it Is and automatically 
changing type of Input detection based on this extra sensor, i.e. if there is to be a 
detection of normal push buttons or a user input unit according to the invention. 

35 Alternatively a user can set the display area for sensing input movements either by 
selection In a menu or by selection when entering the application. 

The input determination unit described earlier can as an alternative be provided as a part 
of the application unit or be part of some other general unit. The input determination unit 
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and the application unit are furthermore normally provided In the form of one or more 
processors with associated program memory or memories storing program code for 
performing the functions of the units. 

5 It Is also possible to implement more than one user input unit In a movement input device, 
but then the portable electronic device would need more touch screens, one for each input' 
unit. Another variation is to use a touch screen technology, where it Is possible to detect 
multiple points of contact at the same time. 

10 With the present invention there has been provided a movement input device that allows 
detection of all angles possible to move around an axis generally perpendicular to the lid In 
a pure "analog" fashion by a touch screen display and in the preferred embodiment also 
the magnitude of the radial movement from the axis. The device Is furthermore cheap to 
manufacture, does not include any electrical components or other types of expensive 

15 devices. Another advantage is that it makes use of a touch screen, which is already 
provided, in the portable electronic device. 

The change to software in the phone for detecting movement inputs is also not hard to 
make, which makes the present Invention even more attractive. 

20 
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CLAIMS 

1. Movement Input device for use on a touch screen (14) of a portable electronic 
device (10) comprising: 

S a fastening unit (16) for securing the movement input device on the portable 

electronic device and having a top and bottom side, said unit also being 
arranged for being placed over at least parts of the touch screen, and 
a user input unit (18) fastened In and stretching through the fastening unit, 
wherein the user input unit comprises: 
10 a user actuation part (26) protruding from the top side of the fastening 

unit and being possible to actuate by a user for free angular movement with 
an angle of rotation around an axis (X) provided at least generally 
perpendicular to the top and bottom sides of the fastening unit, and 
a touch screen contact part (28;36) protruding from the bottom side of the 
X5 fastening unit, which, when the device Is placed for use on the touch screen 

and upon actuation by the user of the user actuation part, Is arranged to 
contact the touch screen In a position where at least an angle of the contact 
position corresponds to the angle of the user actuation part, so that 
movement of the user input unit is detected on the touch screen. 

20 

2. Movement Input device according to claim 1, wherein the user actuation part 
and the touch screen contact part are joined together by a fastening part (30) 

" being fastened in the fastening unit while still allowing free movement round 
said axis. 

3. Movement input device according to claim 1 or 2, wherein the couch screen 
contact part (28) comprises a pin (34) for direct contact on the screen so that a 
radial movement of the touch screen contact part from the axis X corresponds 
to a radial movement of the user actuation part* 

4. Movement input device according to claim 3, wherein the touch screen contact 
part also comprises a spring (32) arranged to force the pin In contact with the 
touch screen. 

35 5, Movement input device according to claims 1 or 2, wherein the touch screen 

contact part (36) comprises a disc having a rim, which contacts the screen at a 
fixed distance from the axis of the screen upon actuation of the user actuation 
part. 



25 



30 
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6. User Input device according to claim 5, wherein the dfsc has parabolic shape. 

7. Portable electronic device (10) comprising: 

a body comprising: a touch screen (14) for detecting Inputs from a user on said 
5 screen, and 

a movement Input device for use on said touch screen comprising: 

a fastening unit (16) for securing the movement input device on the body 
and having a top and bottom side, said unit also being arranged for being 
placed over at least parts of the touch screen, and 
10 a user Input unit (18) fastened in and stretching through the fastening unit, 

wherein the user Input unit comprises: 

a user actuation part (26) protruding from the top side of the 
fastening unit and being possible to actuate by a user for free 
angular movement with an angle of rotation around an axis (X) 
15 provided at least generally perpendicular to the top and bottom ; 

sides of the fastening unit, and 

a touch screen contact part (28) protruding from the bottom side of 
the fastening unit, which, when the movement input device is placed 
for use on the touch screen and upon actuation by the user of the 
20 user actuation part, Is arranged contact the touch screen In a 

position where at least an angle of the contact position corresponds 
to the angle of the user actuation part, so that movement of the 
user input unit is detected on the touch screen. 

25 8. Portable electronic device according to claim 7, further Including an input 

determination unit (40) for determining positions of input from a user. 

9. Portable electronic device according to claim 7 or 8, wherein the fastening unit 
is rotatably connected to the body. 

30 

10. Portable electronic device according to claim 9, wherein the body further 
comprises a fastening unit sensing device arranged to sense If the fastening 
unit is in position for providing Inputs from the movement input device on the 
touch screen. 

35 

11. Portable electronic device according to any of claims 7 - 10, wherein the device 
is a mobile phone. 
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ABSTRACT 

The present invention relates to a movement input device for use on a touch screen (14) 
and a portable electronic device including such a device, where the movement input device 
5 comprises a fastening unit (16) securing the movement input device on the portable 

electronic device, and a user input unit (18) stretching through the fastening unit. The user 
input unit comprises a user actuation part (26) protruding from a top side of the fastening 
unit and actuatable by a user for free angular movement around an axis (X) and a touch 
screen contact part (28) protruding from a bottom side of the fastening unit, which Is 
10 arranged to contact the touch screen in a position where at least an angle of the contact 
position corresponds to an angle of the user actuation part. Movement of the user input 
unit is thus detected On the touch screen. 

Fig. 4 

15 
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